Analyzing Fine-grained Hypertext Features for Enhanced Crawling and Topic Distillation

1st International Workshop on Web Dynamics

After crawling and keyword indexing, the next wave that has made a significant impact on Web search is topic distillation: analyzing properties of the hyperlink graph for enhanced ranking of Web pages in response to a query. Hyperlink induced topic search (HITS) and PageRank (used in Google) are two examples. The linear algebra involved in HITS and PageRank is standard, but selecting the releva...

Lexical Profiling of Existing Web Directories to Support Fine-grained Topic-Focused Web Crawling

Topic-focused Web crawling aims to harness the potential of the Internet reliably and efficiently, producing topic specific indexes of pages within the Web. Previous work has focused on supplying suitably general descriptions of topics to generate large general indexes. In this paper we propose a method that uses lexical profiling of a corpus that consists of hierarchical structures in existing...

INFSCI 2910 - Independent Study : Foundations ( Fall Term

With the fast grow of online educational content, the abundance of quality material opens new opportunities to learners. For practically any domain, a learner can easily find tens, hundreds or even thousand of web pages, tutorials and electronic textbooks in the Internet. Modern educational systems can grasp this opportunity offering alternative content to their users by automatic linking simil...

Unsupervised Discovery of Fine-Grained Topic Clusters in Twitter Posts

An improved joint model: POS tagging and dependency parsing

Dependency parsing is a way of syntactic parsing and a natural language that automatically analyzes the dependency structure of sentences, and the input for each sentence creates a dependency graph. Part-Of-Speech (POS) tagging is a prerequisite for dependency parsing. Generally, dependency parsers do the POS tagging task along with dependency parsing in a pipeline mode. Unfortunately, in pipel...